Intercoder Reliability Dashboard
2025-09-23
## # A tibble: 1 × 1
## avg_agreement
## <dbl>
## 1 0.825| code | n_units | n_coders | percent_agreement | krippendorff_alpha | cohen_kappa | fleiss_kappa | scott_pi | status | total_coded_as_1 | total_coded_as_0 | total_coding_instances | usage_frequency | krippendorff_interpretation | kappa_interpretation |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AI Image/Video (AI or not)_bin | 40 | 4 | 0.875 | 0.7555811 | NA | 0.7550708 | NA | Calculated | 134 | 26 | 160 | 0.8375 | Good | Good |
Problematic Codes
Codes Needing Immediate Attention (Lowest Reliability)
Focus on these codes during training - they show the most disagreement between coders:
1. AI Image/Video_Partly AI_bin High
Agreement: 40.0% | Krippendorff α: 0.359 | Interpretation: Poor | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 4 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 5 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
Agreement: 40.0% | Krippendorff α: 0.359 | Interpretation: Poor | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 4 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 5 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
2. AI Image/Video_Completely AI_bin High
Agreement: 40.0% | Krippendorff α: 0.375 | Interpretation: Poor | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 11 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 2 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
Agreement: 40.0% | Krippendorff α: 0.375 | Interpretation: Poor | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 11 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 2 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
3. Type of Attack__Attack on political
issues/achievements/ideologies_bin High
Agreement: 47.5% | Krippendorff α: 0.402 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 33 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 37 (2 disagreements): X/Twitter Post | DA:✓ DO:✗ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
Agreement: 47.5% | Krippendorff α: 0.402 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 33 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 37 (2 disagreements): X/Twitter Post | DA:✓ DO:✗ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
4. Theme of the Image/Video__Political positioning_bin
High
Agreement: 47.5% | Krippendorff α: 0.409 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 3 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 4 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
Agreement: 47.5% | Krippendorff α: 0.409 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 3 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 4 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
5. Type of Acclaim__Acclaim/Praise/Recognition of political
issues/achievements/ideologies_bin High
Agreement: 52.5% | Krippendorff α: 0.291 | Interpretation: Poor | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 27 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✓
Agreement: 52.5% | Krippendorff α: 0.291 | Interpretation: Poor | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 27 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✓
6. Theme of the Image/Video__Negative imagery/Negative
campaigning: The image/video portrays the political opponent in a
negative light. This can happen through sharp criticism or with
humor._bin Mid
Agreement: 52.5% | Krippendorff α: 0.451 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 4 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 7 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 32 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 35 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 38 (2 disagreements): X/Twitter Post | DA:✓ DO:✓ E:✗ L:✗
Agreement: 52.5% | Krippendorff α: 0.451 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 4 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 7 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 32 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 35 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 38 (2 disagreements): X/Twitter Post | DA:✓ DO:✓ E:✗ L:✗
7.
Topics__political_parties_and_politicians_candidate_presentation_politicians_as_the_main_subject_bin
Mid
Agreement: 52.5% | Krippendorff α: 0.473 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 14 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 34 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
Agreement: 52.5% | Krippendorff α: 0.473 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 14 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 34 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
8. Type of Attack__Attack on a
person/party/organization/institution_bin Mid
Agreement: 55.0% | Krippendorff α: 0.534 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 17 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✓
- Content 2 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
Agreement: 55.0% | Krippendorff α: 0.534 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 17 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✓
- Content 2 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
9. Type of Acclaim__Acclaim/Praise/Recognition of a
person/party/organization/institution_bin Mid
Agreement: 57.5% | Krippendorff α: 0.525 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 5 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 39 (1 disagreements): Facebook Post | DO:✓ E:✓ L:✓
Agreement: 57.5% | Krippendorff α: 0.525 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 5 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 39 (1 disagreements): Facebook Post | DO:✓ E:✓ L:✓
10. Target of Attack__(Members of) minorities_bin Mid
Agreement: 57.5% | Krippendorff α: 0.423 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 23 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
Agreement: 57.5% | Krippendorff α: 0.423 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 23 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
11. Actors__(Members of) minorities_bin Mid
Agreement: 57.5% | Krippendorff α: 0.485 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 28 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
Agreement: 57.5% | Krippendorff α: 0.485 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 28 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
12. Theme of the Image/Video__Events/Landscape & city
scenes: Unlike a symbolic image, people/politicians are doing something,
moving, or working (e.g., groups such as politicians, refugees, farmers,
protesters, police officers, etc.). Alternatively, a city or (natural)
landscape is shown where something is happening (e.g., forest dieback,
fire, or flooding, nuclear power plants or wind turbines)._bin
High
Agreement: 60.0% | Krippendorff α: 0.164 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 22 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
Agreement: 60.0% | Krippendorff α: 0.164 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 22 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
13. Theme of the Image/Video__Symbolic image of
person(s)/politician(s)/citizen(s) looking directly into the camera
(classic campaign poster image)._bin Mid
Agreement: 60.0% | Krippendorff α: 0.485 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 23 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
Agreement: 60.0% | Krippendorff α: 0.485 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 23 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
14. Actors__Ordinary people / average citizens / ordinary
supporters_bin Mid
Agreement: 60.0% | Krippendorff α: 0.551 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 8 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 27 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
Agreement: 60.0% | Krippendorff α: 0.551 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 8 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 27 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
15. People in the
Image/Video__Ordinary_people___average_citizens___ordinary_supporterse_g_individuals_as_well_as_groups_of_citizens_such_as_teachers__pensioners__students__caregivers__etc___bin
Mid
Agreement: 62.5% | Krippendorff α: 0.595 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 22 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
Agreement: 62.5% | Krippendorff α: 0.595 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 22 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
16. Target of Acclaim__PVV_bin Low
Agreement: 65.0% | Krippendorff α: 0.621 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 5 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 39 (1 disagreements): Facebook Post | DO:✓ E:✓ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
Agreement: 65.0% | Krippendorff α: 0.621 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 5 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 39 (1 disagreements): Facebook Post | DO:✓ E:✓ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
17. Theme of the Image/Video__Positive imagery/Acclaims: The
image/video portrays past and future achievements of the
party/government in a positive light. This includes drawing a positive
balance, saying “thank you” to campaign helpers, or positively
discussing political plans/goals._bin High
Agreement: 65.0% | Krippendorff α: 0.088 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 5 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 19 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
Agreement: 65.0% | Krippendorff α: 0.088 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 5 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 19 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
18. AI Labeling in Post/Ad_bin Mid
Agreement: 65.0% | Krippendorff α: 0.487 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 9 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 10 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 4 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
Agreement: 65.0% | Krippendorff α: 0.487 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 9 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 10 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 4 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
19. Target of Acclaim__PVV: Geert Wilders_bin Mid
Agreement: 65.0% | Krippendorff α: 0.487 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 9 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 27 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
Agreement: 65.0% | Krippendorff α: 0.487 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 9 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 27 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
20. Theme of the Image/Video__Event announcement/Election
call/Candidate presentation_bin High
Agreement: 67.5% | Krippendorff α: 0.363 | Interpretation: Poor | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 10 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
Agreement: 67.5% | Krippendorff α: 0.363 | Interpretation: Poor | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 10 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
21. Number of People in the Image/Video_bin Mid
Agreement: 67.5% | Krippendorff α: 0.570 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 23 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✓ L:✗
Agreement: 67.5% | Krippendorff α: 0.570 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 23 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✓ L:✗
22.
Topics__civil_rights_including_gender_politics_lgbtq_policies_bin
High
Agreement: 70.0% | Krippendorff α: 0.146 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 32 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 10 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
Agreement: 70.0% | Krippendorff α: 0.146 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 32 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 10 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
23. People in the
Image/Video___Members_of__minoritiese_g_refugeesLGBTQ_people_with_disabilities__Jewish_people__women__when_women_are_explicitly_labeled__depicted__or_referred_to_as_a_minority__bin
Mid
Agreement: 70.0% | Krippendorff α: 0.553 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 22 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 27 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 33 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
Agreement: 70.0% | Krippendorff α: 0.553 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 22 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 27 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 33 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
24. Target of Acclaim__Ordinary people / average citizens /
ordinary supporters_bin High
Agreement: 75.0% | Krippendorff α: 0.081 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 39 (2 disagreements): Facebook Post | DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
Agreement: 75.0% | Krippendorff α: 0.081 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 39 (2 disagreements): Facebook Post | DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
25.
Topics__election_in_general_electoral_system_campaign_events_campaign_dates_campaign_appearances_election_polls_bin
High
Agreement: 80.0% | Krippendorff α: 0.188 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 14 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
Agreement: 80.0% | Krippendorff α: 0.188 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 14 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
26. Topics__other_political_topic_bin High
Agreement: 82.5% | Krippendorff α: -0.044 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 5 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 11 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 22 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 26 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
Agreement: 82.5% | Krippendorff α: -0.044 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 5 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 11 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 22 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 26 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
27. Actors__Dutch government, ministries, parliament, and courts
(ALSO KABINET SCHOOF)_bin High
Agreement: 82.5% | Krippendorff α: 0.037 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 35 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 23 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
Agreement: 82.5% | Krippendorff α: 0.037 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 35 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 23 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
28. Topics__environmental_and_energy_policy_bin Mid
Agreement: 85.0% | Krippendorff α: 0.542 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 18 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 33 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✓
Agreement: 85.0% | Krippendorff α: 0.542 | Interpretation: Moderate | Units: 40
Example disagreements:
- Content 18 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 33 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✓
29. Target of Attack__Dutch government, ministries, parliament,
and courts (ALSO KABINET SCHOOF)_bin High
Agreement: 87.5% | Krippendorff α: -0.030 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
Agreement: 87.5% | Krippendorff α: -0.030 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
30. Theme of the Image/Video__Other imagery_bin High
Agreement: 87.5% | Krippendorff α: 0.078 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 37 (2 disagreements): X/Twitter Post | DA:✓ DO:✓ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 14 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 40 (1 disagreements): Instagram Post | DO:✓ E:✗ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
Agreement: 87.5% | Krippendorff α: 0.078 | Interpretation: Very Poor | Units: 40
Example disagreements:
- Content 37 (2 disagreements): X/Twitter Post | DA:✓ DO:✓ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 14 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 40 (1 disagreements): Instagram Post | DO:✓ E:✗ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
Acceptable and Good Codes (≥ 0.667 Krippendorff’s Alpha)
These codes show good to excellent reliability between coders:
People in the Image/Video__PVV__Geert_Wilders_bin
Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 15.0% (24/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
Actors__CDA_bin
Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 10.0% (16/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Actors__CDA: Henri Bontenbal_bin
Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 7.5% (12/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Target of Attack__CDA_bin
Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 10.0% (16/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 7 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 8 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 9 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Target of Attack__CDA: Henri Bontenbal_bin
Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 7.5% (12/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 7 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 8 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 9 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Actors__GL-PvdA_bin
Agreement: 97.5% | Krippendorff α: 0.970 | Interpretation: Excellent | Units: 40 | Usage: 29.4% (47/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Actors__GL-PvdA: Frans Timmermans_bin
Agreement: 97.5% | Krippendorff α: 0.968 | Interpretation: Excellent | Units: 40 | Usage: 26.9% (43/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Target of Attack__GL-PvdA_bin
Agreement: 92.5% | Krippendorff α: 0.896 | Interpretation: Excellent | Units: 40 | Usage: 27.5% (44/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 7 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 8 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 9 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Target of Attack__GL-PvdA: Frans Timmermans_bin
Agreement: 92.5% | Krippendorff α: 0.889 | Interpretation: Excellent | Units: 40 | Usage: 25.0% (40/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 7 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 8 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 9 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
AI Image/Video_Not AI_bin
Agreement: 95.0% | Krippendorff α: 0.882 | Interpretation: Excellent | Units: 40 | Usage: 14.4% (23/160)
Example disagreements:
- Content 11 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 18 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 1 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Actors__PVV: Geert Wilders_bin
Agreement: 87.5% | Krippendorff α: 0.867 | Interpretation: Excellent | Units: 40 | Usage: 48.8% (78/160)
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
Actors__PVV_bin
Agreement: 87.5% | Krippendorff α: 0.860 | Interpretation: Excellent | Units: 40 | Usage: 61.3% (98/160)
Example disagreements:
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 36 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✓
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
People in the Image/Video__GL_PvdA__Frans_Timmermans_bin
Agreement: 87.5% | Krippendorff α: 0.800 | Interpretation: Excellent | Units: 40 | Usage: 19.4% (31/160)
Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 37 (1 disagreements): X/Twitter Post | DA:✓ DO:✓ E:✓ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
People in the Image/Video__CDA__Henri_Bontenbal_bin
Agreement: 95.0% | Krippendorff α: 0.787 | Interpretation: Good | Units: 40 | Usage: 6.2% (10/160)
Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Topics__call_to_vote_get_out_the_vote_call_without_and_with_naming_of_party_s_bin
Agreement: 80.0% | Krippendorff α: 0.765 | Interpretation: Good | Units: 40 | Usage: 39.4% (63/160)
Example disagreements:
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
- Content 14 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✓
AI Image/Video (AI or not)_bin
Agreement: 87.5% | Krippendorff α: 0.756 | Interpretation: Good | Units: 40 | Usage: 83.8% (134/160)
Example disagreements:
- Content 11 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✓ L:✗
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
Negative Tendency/Tonality_bin
Agreement: 87.5% | Krippendorff α: 0.756 | Interpretation: Good | Units: 40 | Usage: 83.8% (134/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 5 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
Positive Tendency/Tonality_bin
Agreement: 87.5% | Krippendorff α: 0.756 | Interpretation: Good | Units: 40 | Usage: 83.8% (134/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 5 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
Theme of the Image/Video__Humor / Satire (depictions used to mock, exaggerate, or parody)_bin
Agreement: 80.0% | Krippendorff α: 0.743 | Interpretation: Good | Units: 40 | Usage: 30.0% (48/160)
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 37 (2 disagreements): X/Twitter Post | DA:✗ DO:✗ E:✓ L:✓
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 17 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
Actors__VVD_bin
Agreement: 92.5% | Krippendorff α: 0.694 | Interpretation: Good | Units: 40 | Usage: 8.1% (13/160)
Example disagreements:
- Content 24 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✓
- Content 28 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✓
- Content 23 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 1 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Topics__domestic_and_migration_policy_public_safety_crime_incl_femicide_political_radicalism_religious_fanaticism_terrorism_bin
Agreement: 72.5% | Krippendorff α: 0.692 | Interpretation: Good | Units: 40 | Usage: 51.9% (83/160)
Example disagreements:
- Content 10 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 11 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 35 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
Theme of the Image/Video__Nostalgic / historical Dutch imagery (references to glorified past or national symbols)_bin
Agreement: 90.0% | Krippendorff α: 0.688 | Interpretation: Good | Units: 40 | Usage: 8.8% (14/160)
Example disagreements:
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 13 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 14 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
- Content 1 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Most Problematic Content Pieces (Highest Overall Disagreement)
These content pieces have the most disagreements across all codes:
- Content
40: 43 total disagreements across 33 codes |
Instagram
Post
- Content 26: 34 total disagreements across 24 codes | Instagram Post
- Content 33: 34 total disagreements across 28 codes | TikTok Video
- Content 1: 33 total disagreements across 24 codes | Facebook Post
- Content 39: 33 total disagreements across 25 codes | Facebook Post
- Content 11: 31 total disagreements across 17 codes | Facebook Post
- Content 30: 30 total disagreements across 27 codes | TikTok Video
- Content 10: 29 total disagreements across 25 codes | Facebook Post
- Content 35: 29 total disagreements across 22 codes | TikTok Video
- Content 8: 28 total disagreements across 20 codes | Facebook Post
Content Review
Content Review
Content 1
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 2
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 3
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 4
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 5
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 6
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 7
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 8
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 9
Coders: Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Do:✓ El:✓ Ly:✓
Content 10
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Data Tables
Complete Reliability Statistics
Most Problematic Codes
Content Index
Code Search Tool
Use this table to search for any code and see all content that was coded with that code.
Search by Code
Coding Coverage by Coder:
- Doortje: 40 unique URLs coded
- Lynn: 40 unique URLs coded
- Ella: 39 unique URLs coded
- Daisy: 38 unique URLs coded
Type any code name in the search box below to find all content that was coded with that code.
Note: This table only shows content that was coded by at least 2 coders to ensure meaningful comparisons.
Dashboard generated on 2025-09-23 18:30:10.574687
Summary
Key Implementation Updates:
✅ Category Alignment Fixed: All binary conversion
logic now uses exact category text from categories.txt
✅ Conditional Coding Logic Implemented: - If coder determined image/video is “NOT AI-generated”, then ALL subsequent variables (AI Labeling, Number of People, Tonality, etc.) are correctly treated as NA (not coded) - This ensures reliability calculations only include coders who had the opportunity to code each variable
✅ AI Binary Variables Working: - “Partly AI-generated” correctly counts as 1 in “AI or not” binary variable - All AI categories (Completely, Partly, Not AI, Unsure) properly converted to binary format
Impact: - 23 responses were coded as “NOT AI-generated” - These coders are now correctly excluded from reliability calculations for subsequent variables - More accurate Krippendorff’s Alpha calculations for AI-related and content variables